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Response to Amendment 

1 . Applicants' response to the last Office Action, filed 05/24/2007 has been entered 
and made of record. 

2. Applicants' amendment has required new grounds of rejection. New grounds of 
rejection are therefore presented in the Office Action. 

3. Applicant's arguments have been fully considered but are moot in view of the 
new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which fomis the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1-21 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Fazzari (US-PAT-NO: 5887073) in view of Queiroz, "Mixed raster content (MRC) model for 
compound image compression" Proc. SPIE 3653, 1 106 (1998). 

0 Regarding Claims 1,8,13,17: 

r 

(Note: if no name mentioned, please assume Fazzari reference.) 

For Claim 13. A storage medium (27) storing a set of program instructions executable on 
a data processing device (27), the set of program instructions (software) comprising: 
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(Abstract: "control console displays a graphical user interface via a computer on which the 
control system is implemented and includes a software application pack specifically configured 
for processing a particular type of food." 

Column 4, lines 45-55, "A personal computer 27 implements a control processor 26 and 
memory-based software . . . ") 

An apparatus, comprising: 

a blob (colors, properties, features, objects.) identifier {F\gZ: 54. Col5 lines 15-20) 
ttiat identifies one or more blobs (Col6 line 2: blobs) in image data; 
(Figure 5; 96, 98 and 100 were identified as blobs of 91. 

Column 5, line 37, "FIG. 4, an attribute can be defined as a collection of points in red- 
green-blue space (RGB) space, which can be considered the same color for the sorting 
application." Column 10, lines 18-21, "70 first identifies as objects all spatially 
contiguous groups of pixels, i.e. blobs, in each binary attribute plane and each binary 
property".) a blob mapper (64) that assigns a color index (attribute) to each of one or 
more blobs based on a color property (Fig4: 92,93,94) of each of the blobs; and 
(Column 5, lines 55-56, "color classifier 64 shown in both of FIGS. 3 and 5 will classify 
each 24-bit RGB pixel from color image 91 into exactly one of these attributes.") 

a blob clusterer {F\g5. 64) that assigns the blobs to one or more binary 
foreground planes (88,90) and a grayscale background plane (89) based on the color 
index of each of the blobs; and 
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(Figure 5; 96, 98 and 1 00 were identified as blobs of 91 . They were assigned to planes . 
88. 89. 90 because they correspond to color clouds 92-94 in Figure 4. 96 belongs to 
color cloud 92; see Column 5. line 44 and Column 8, lines 35-45. The color classifier is 
a blob clusterer. 

Column 5, line 58, "The color classifier does this by creating a binary image, or "attribute 
image," for each attribute from the 24-bit color image 91 that the color classifier 
processes.") 

Fazzari disclose everything as described above except, dafa of the one or more 
assigned binary foreground planes and the grayscale background plane are 
compressed by applying separate compression algorithms to each binary foreground 
plane data and grayscale background plane data. 

Queiroz discloses, data of the one or more assigned binary foreground planes 
and the grayscale background plane are compressed (Title.MRC) by applying separate 
compression algorithms (JPEG, JBIG) to each 

binary foreground plane data and (Page 4 Paragraph 2 "In both cases. . . ", 
"text objects and edges are placed in the binary mask layer, thus, being efficiently 
encoded using standard binary coders such as MMR, JBIG") 

grayscale background plane data. (Page 4 Paragraph 2, JPEG) 

It is efficient to compress a binary image using JBIG and a continuous tone 
image, or image with "large uniform patches", with JPEG. Therefore, it would have 
been obvious to one having ordinary skill in the art at the time the invention was made 
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to use Queiroz's MRC method in Fazzari; encode binary image witli JBIG and a 
continuous image with JPEG. 

0 Regarding Claims 2,9,14,18: 

(Queiroz reference.) 

The apparatus of claim 1, wherein the blob (Queiroz. Fig4: graphics, text) clusterer 
(Page4: regions containing text and graphics are identified and represented in a 
separate plane.) 

separates blobs (graphics, text) having a same color index (Fig4: Bird has the 
same color index) into one or more proximity groups (FG, M, BG planes) based on a 
predetermined blob separation distance (Fig4: Bird's feet, stomach, wings, have the 
same separation distance in the original and BG plane.), and 

then assigns each of the proximity groups (objects) to a separate foreground 

plane. 

(Fig4 shows separate planes containing separate objects.) 

a size (dimension) of each of the foreground planes (Fig4) being set based on 
spatial characteristics of pixels of blobs assigned to each of the foreground planes. 
(Page 3 paragraph 3: Layers may contain different dimensions and have offsets 
associated with them. If a plane contains only a small object, the effective plane can be 
made of a bounding box around the object.) 

0 Regarding Claims 10: 
(Queiroz reference.) 
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The method of claim 8, further comprising: setting a size (dimension) of each of 
the foreground planes based on spatial characteristics of pixels of blobs assigned to 
each of the foreground planes (Fig4). 

(Page 3 paragraph 3: Layers may contain different dimensions and have offeets 
associated with them. If a plane contains only a small object, the effective plane can be 
made of a bounding box around the object.) 

0 Regarding Claims 3,11,16,20: 

The apparatus of claim 1, wherein the blob clusterer assigns to a background plane one 
or more portions of the image data that are not assigned into any foreground plane. 
(89 in Figure 5 is the "Background Attribute Image." It contains unassigned data.) 

0 Regarding Claims 4,1 2,1 5,1 9: 

The apparatus of claim 1, wherein the blob mapper assigns an identical color 
index (attribute) to each of the one or more blobs, if a difference between color 
properties of the blobs is within a predetermined tolerance (Fig4: 92,93,94 is the 
tolerance). 

(Column 5, lines 52-56, "each attribute will have a corresponding color cloud in RGB- 
space. Once all attributes have been defined for a given application and corresponding 
color clouds have been created, the color classifier 64 shown in both of FIGS. 3 and 5 
will classify each 24-bit RGB pixel from color image 91 into exactly one of these 
attributes.") 
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0 Regarding Claim 5: 

A xerographic marking device incorporating Uie apparatus of claim 1 . 

(Column 7, lines 15-19 "Alternatively, any optical imaging device can be 
substituted for the camera, including a grey-scale video camera, a photocell device, a 
laser scanner, an ultraviolet camera, an infrared camera, a Magnetic Resonance 
Imaging (MRI) device, or a spectroscopic scanner.") 

0 Regarding Claim 6: 

A marking device incorporating ttie apparatus of claim 1. 
(49 in Figure 2 is a pen, which is a marking device, incorporating the overall apparatus. 
Column 7, lines 15-19 "Alternatively, any optical imaging device can be substituted for 
the camera, including a grey-scale video camera, a photocell device, a laser scanner, 
an ultraviolet camera, an infrared camera, a Magnetic Resonance Imaging (MRI) 
device, or a spectroscopic scanner.") 

0 Regarding Claim 7: 

A digital photocopier incorporating the apparatus of claim 1. 
(Column 7, lines 15-19 "Alternatively, any optical imaging device can be substituted for 
the camera, including a grey-scale video camera, a photocell device, a laser scanner, 
an ultraviolet camera, an infrared camera, a Magnetic Resonance imaging (MRI) 
device, or a spectroscopic scanner.") 

6. Claim 21 is rejected under 35 U.S.C. 103(a) as being unpatentable over Fazzari 
(US-PAT-NO: 5887073) in view of Queiroz, "Mixed raster content (MRC) model for 
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compound image compression" Proc. SPIE 3653, 1 106 (1998) and further in view of Majid 
Rabbani, "An overview of the JPEG 2000 still image compression standard", Signal 
Processing: Image Communication, Volume 17, Issue 1, January 2002, Pages 3-48. 
0 Regarding Claim 21 : 

Fazzari and Queiroz disclose everytliing as described above except, creating a 
color tree from the assigned blobs. 

Rabbani, who deals with JPEG 2000, discloses on page 23 Fig 15, "Example of 
compressed data associated with various sub-bitplane coding passes"; on Page 27 Col 
2, "Component-position-resolution-layer progression (CPRL)". The color tree is the 
bitplanes from all the codeblocks, arranged from MSB to LSB, arranged by color 
component. 

Since Quejroz discloses on page 4 paragraph 2, "background plane is suitable 
for continuous tone image compressors such as JPEG or JPEG-2000", it would have 
been obvious to one having ordinary skill in the art at the time the invention was made 
to use Rabbani in the method of Queiroz, both are discussing JPEG 2000; partition data 
into codeblocks, where each codeblock is arranged from most significant coefficients to 
least significant coefficients and arrange data in progression by component. This 
creates a color tree. 

Conclusion 

7. Prior art made of record and not relied upon Is considered pertinent to applicant's 
disclosure. DeLeeuw discloses, "Placing and monitoring transparent user interface 
elements in a live video stream as a method for user input." 
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8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Max Shikhman whose telephone number is (571) 270- 
1669; FAX (571) 270-2669. The examiner can nomially be reached on Monday-Friday 
8:30AM-6:00PM EST. 

If attempts to reach the examiner by telephone arie unsuccessful, the examiner's 
supervisor. JINGGE WU can be reached on (571) 272-7429. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Max Shikhman 
7/30/2007 



